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Abstract 

The notion of Fejer monotonicity has proven to be a fruitful concept in fixed point theory 
and optimization. In this paper, we present new conditions sufficient for convergence of 
Fejer monotone sequences and we also provide applications to the study of nonexpansive 
mappings. Various examples illustrate our results. 
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1 Introduction 


We assume throughout the paper that 

X is a real Hilbert space (1) 

with inner product (■, ■) and induced norm || • ||. Let C be a nonempty closed convex subset 
of X. A sequence (x n )neN in X is called Fejer monotone (see, e.g., iTTOll . IflTl and El) with 
respect to C if 

(VceC)(VneN) \\x n+ i — c\\ < \\x n — c\\. (2) 
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In other words, each point in a Fejer monotone sequence is not further from any point in 
C than its predecessor. This property has known to be an efficient tool to analyze various 
iterative algorithms in convex optimization. 

The goal of this paper is to present some new conditions sufficient for convergence of Fejer monotone 
sequences. We also provide applications to the study of nonexpansive mappings. 

The paper is organized as follows. In Section 2, we deal with Fejer monotonicity. Section 3 
is devoted to applications in fixed point theory. Section 4 concludes the paper with a list of 
open problems. 

The notation we employ is standard and follows, e.g., [|4|. 


2 Fejer monotonicity 


We start by recalling some pleasant properties of Fejer monotone sequences. 

Fact 2.1. Let be a sequence in X that is is Fejer monotone with respect to a nonempty closed 

convex subset C of X. Then the follozving hold: 

(i) The sequence (x„)„ G ]n is bounded. 

(ii) For every c G C, the sequence (||x„ — c||)„ 6 ]n converges. 

(iii) The set of strong cluster points of ( x n ) ne f^ lies in a sphere ofX. 

(iv) The "shadozv sequence" (Pcx n ) n e in converges strongly to a point in C. 

(v) If int C/0, then (x n ) ne ]N converges strongly to a point in X. 

(vi) IfC is a closed affine subspace ofX, then (Vn G N) Pcx n = Pc% o- 

(vii) Every weak cluster point of (x^jneN that belongs to C must be lim„^oo Pc x n- 

(viii) The sequence (x n ) n eN converges weakly to some point in C if and only if all weak cluster points 
of(x n )neK be in C. 

(ix) If all weak cluster points of(x n ) ne f ^ lie in C, then ( x n ) ne nj converges zveakly to lim ); _j.oo Pc x „. 


Proof. (i)§z(ii) DU Proposition 5.4], (iii) Clear from (ii) (iv) DU Proposition 5.7], |(v)| (4j 


Proposition 5.10]. (vi) 


DU Proposition 5.9(i)]. |(vii)| This follows from HI Corollary 5.11]. 

]with[(vii) ■ 


(viii) This follows from DU Theorem 5.5]. (ix) Combine (viii) 


The following result was first presented in D2J Theorem 6.2.2(ii)]; for completeness, we 
include its short proof. 

Lemma 2.2. Let (x n ) nG ]N be a sequence in X that is is Fejer monotone with respect to a nonempty 
closed convex subset C of X. Let w\ and zoi be zveak cluster points of ( x n ) ne f j. Then zvi — w 2 G 
(C-C)-L. 
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Proof. Let (ci,C 2 ) G C x C. Using Fact 2.1 ii) set Li : = lim tt _j.oo \\x n — Cj\\, for i G {1/2}. Note 
that 


\x n - Cl = \\x n - c 2 


|ci -c 2 || +2(x 2 -c 2 /C 2 -ci). 


(3) 


Now suppose that x^ n — *• W\ and X\ n — >• w 2 . Taking the limit in (|3j) along the two 
subsequences (k n )neN and (Z n )neN yields Li = L 2 + ||c 2 — Ci|| 2 + 2(o>i — n; 2 , c 2 — ci) and 
Li = L 2 T ||c 2 — Ci11 2 T 2(w 2 — ry 2/ c 2 — ci). Subtracting the last two equations yields 
2 (C 2 — Ci/ltf! — w 2 ) =0. ■ 


We are now ready for our first result which can be seen as a finite-dimensional variant of 
(6l Lemma 2.1] (where A is a closed linear subspace) and Fact 2.1 viii) (where A = X). 


Proposition 2.3. Suppose that X is finite-dimensional, let (x„) J!6 ]n he a sequence in X that is Fejer 
monotone with respect to a nonempty closed convex subset C ofX, and let A be a closed convex subset 
of X such that CCA. If all cluster points of (P^x„)„ e n lie in C, then (P^x „) ne ]n converges; in 
fact, 

lim PaX h = lim Pcx n . (4) 

n—> 00 n —yoo 


Proof. Set c* := lim i5 ^oo Pcx n (see Fact 2.1 iv) I. By Fact 2.1 i) (x n )neN is bounded, hence so 


is (PA x n)ne in because Pa is nonexpansive. Now assume that all cluster points of (P/AhJhsn 
lie in C. Let c be an arbitrary cluster point of ( P A x n )ncK- Then there exist a subsequence 
(*Jfc„)neN °f (l)«cN and a point x G X such that x^ n —> x and PaXi (ii —> Pax = c G C. It 
follows that c* x- Pc x k n Pc c = c - Hence c = c* and the result follows. ■ 


Our second result decouples Fejer monotonicity into two properties in the case when the 
underlying set can be written as the sum of a set and a cone. 

Proposition 2.4. Let (x n ) ne f^ be a sequence in X, let E be a nonempty subset of X and let Kbe a 
nonempty convex cone ofX. Then the following are equivalent: 

(i) (*«)neN is Fejer monotone with respect to E + K. 

(ii) (*n) „ 6 n is Fejer monotone with respect to E and (Vn G N) x n+ \ G x n + K ®, where X® : = 
{u G X | inf(w,X) > 0}. 

Proof. Set 

(ViGX)(VnGN) A n (x) := \\x n - x\\ 2 - \\x n+1 - x\\ 2 . (5) 

Then for every e G E and k G K, we have 

A n (e + k) = \\x n - e\\ 2 + ||Zc|| 2 - 2 (x n - e,k) - ( \\x n+1 - e|| 2 + \\k\\ 2 - 2 (x n+1 -e,k) ) (6a) 
= A„(e) +2(x n+1 -x„,k). (6b) 

Assume first that [(i)] holds. Then (x n ) ne f^ is Fejer monotone with respect to E because E C 
E + K. Let (e,k) G E x K and n G N. Using & 

0 < A n (e + k) = A n (e) + 2 (x n+1 - x n ,k). (7) 
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Since K is a cone, this shows that 2 inf {x n+ \ — x n , R ++ /c) > —A n (e) > — oo. Hence 
{x n+ \ — x n ,k) > 0. It follows that x n+ \ — x n G X®. Conversely, if (ii) holds, then |6]) im¬ 
mediately yields [(I)] ■ 


The following consequence of Proposition |2.4| shows that Proposition |2.4| is a generaliza¬ 
tion of Fact [2dfvi) 


Corollary 2.5. Let (x n ) n e]N be a sequence in X, and let C be a closed affine subspace of X, say 
C = c + Y, where Y is a closed linear subspace ofX. Then (x ;! )mgn zs Lejer monotone with respect to 
Y if and only if (Vn G IN) \\x n+ \ — c|| < \\x n — c|| and x n+ \ Gi b + Y®, in which case (Pcx„) ne n 
is a constant sequence. 


We continue with the following lemma, which is a slight generalization of a theorem of 
Ostrowski (see lfT5l Theorem 26.1]) whose proof we follow. 

Lemma 2.6. Let (Y, d) be a metric space, and let (x n ) ne w be a sequence in a compact subset CofY 
such that d(x n ,x n+ i) —> 0. Then the set of cluster points of (x n ) ne f^ is a compact connected subset 
ofC. 

Proof Denote the set of cluster points of (x„)„ e: r\j by S and assume to the contrary that S = 
A U B where A and B are nonempty closed subsets of X and An B = 0. Then 

5 := inf d(a,b) > 0. (8) 

(a,b)eAxB 

By assumption on {x n ) ne ^\, there exists uq G N such that (Vn > no) d(x n ,x n+ i) < S/3. 
Let a G A. Then there exists m > no such that d(x m ,a) < S/3. Because (x n ) n>m has a 
cluster point in B, there exists a smallest integer k > m such that d(x k , B) < 2S/3. Then 
d(xk-\,B) > 2S/3 and hence d(xk,B) > d(xk-i,B) — d{xk-i,Xk) > 2S/3 — S/3 = S/3. Thus 
S/3 < d(Xk,B) < 2S/3. Repeating this argument yields a subsequence (X)c„)neN of (x«)neN 
such that (Vn G N) S/3 < d(xk n ,B) < 2S/3. Let x be a cluster point of (xjcJugin- It follows 
that 

5/3 <d(x,B) <25/3 (9) 

Obviously, x B. Hence x G A, and therefore (recall (|8jl ) S < S(x,B ) < 25/3 < S, which is 
absurd. ■ 


An immediate consequence of Lemma [2A] is the classical Ostrowski result. 

Corollary 2.7 (Ostrowski). Suppose that X is finite-dimensional and let ( x n ) ne ^ be a bounded 
sequence in X such that (x„) n6 ]N is asymptotically regular, i.e., x n — x n+ \ —r 0. Then the set of 
cluster points of ( x n ) ne ^ is compact and connected. 

We are now in position to prove the following key result which can be seen as a variant of 
Fact |2.1|[v)| 
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Theorem 2.8 (a new sufficient condition for convergence). Suppose that X is finite¬ 
dimensional and that C is a nonempty closed convex subset ofX of co-dimension 1, i.e., 

codim C := codim (aff C — aff C) = 1. (10) 

Let (x n )neN be a sequence that is Fejer monotone with respect to C and asymptotically regular, i.e., 
x n — x n +i —> 0. Then (x n )neN is actually convergent. 


Proof. By Fact 2.1 JjJ (x n ) n eN is bounded. Denote by S the set of cluster points of (x n )neiN 


Since x n — x n+ \ —> 0, Corollary |2.7| implies that S is connected. Moreover, S lies in a sphere 
of X due to Fact |2.1|jhi)| On the other hand, by combining Lemma |2.2| and ( fToj l, S lies in a line 
of X. Altogether S is a connected subset of a sphere that lies on a line. We deduce that S is a 
singleton. ■ 


We conclude with two examples illustrating that the assumptions on asymptotic regularity 
and co-dimension 1 are important. 

Example 2.9. Suppose that X = 1R 2 , set C = {0} x R, and (Vn G IN) x n = ((—1)",0). Then 
codim C = 1 and (Vc G C) (Vn G N) \\x„ — c|| = \\x n+ \ — c\\, hence (x n )neN is Fejer mono¬ 
tone with respect to C. However, (x n )neN does not converge. This does not contradict The¬ 
orem |2.8| because \\x n — x n+ i\\ = 2 /> 0. 

Example 2.10. Suppose that X = R 2 , set C = {(0,0)} C X, and (Vn G IN) 6 n = £} ! =1 (l/ft:) 
and x n = cos(0„)(l,O) + sin(0„)(0,1). Then (jt„) n eN is asymptotically regular and Fejer 
monotone with respect to C. However, the set of cluster points of (i,,),,.^ is the unit sphere 
because the harmonic series diverges. Again, this does not contradict Theorem |2.8| because 
codim C = 2 1. 


3 Asymptotic behaviour of nonexpansive mappings 


From now on, we assume that 


T: X —> X is nonexpansive. (11) 

Let x and y be in X. It is clear that (Vn G IN) ||T' !+1 x — T n+1 y\\ < ||T”x — T n y\\ is bounded. 
The following question is thus extremely natural: 

Under which conditions on T must ( T n x — T"y) ne in always converge weakly? (12) 

We first note that (12] | will impose some restriction on T: 

Example 3.1. Suppose that X = R, that T = — Id, that x 0 and that y = 0. Then the 
sequence (T n x — T n y) ne ^ = ((—l)"x)„ e jsj is not convergent. 

The following two results are well known. 
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Fact 3.2. (See, e.g., Iil6l Corollary 6].) Exactly one of the following holds: 

(i) Fix(T) = 0 and (Vx G X) ||T”x|| —> oo. 

(ii) Fix(T) 0 and (Vx G X) ( T n x) ne t^ is bounded. 


Fact 3.3. (See, e.g., DU Theorem 1.2].) Suppose that Fix(T) f 0 and let x G X. Then (T n x) ne ^ 
is weakly convergent if and only ifT n x — T' 1+1 x —^ 0; if this is the case, then (T”x)„ G ] n converges 
weakly to a point in Fix(T). 


To make further progress, let us recall that ran (Id — T) is a nonempty closed convex set, 
which makes the vector 

v : = -Pfan(ld-T)0 (13) 

well defined (see @, HU and HU), and which gives rise to the generalized (possibly empty) 
fixed point set 

Fix(u + T) = {xGX|x = u + Tx} . (14) 


We now recall the following helpful fact. 

Fact 3.4. (See ||8] Proposition 2.4].) Suppose that Fix(u + T) f 0. Then the following hold: 

(i) Fix(u + T) — lR + u C Fix(u + T). 

(ii) (Vy G Fix(u + T))(Vn G N) T n y = y — nv. 

(iii) For every x G X, the sequence (T”x + nv) n& \ n is Tejer monotone with respect to Fix(u + T). 

Remark 3.5. Suppose that Fix(u + T) f 0. Then 


(VxGX)(VyGX) (T"x — T"y)„ e ]N is weakly convergent 


(15a) 


(15b) 


if and only if 

(Vx G X) (T n x + nv) ne ] n is weakly convergent. 

Indeed, if (|15a|l holds, then (|15b|) follows by choosing y G Fix(z’ + T) and recalling Fact 3. m 
Conversely, assume that ( |15b| holds. Then (T"x + nv) ne in and ( T n y + nv) ne ] n are weakly 
convergent, and so is their difference which yields ( 15a[>. 


We can now give a mild sufficient condition for ( ]l2| : 

Theorem 3.6. Suppose that X = 1R, that v f 0, and that Fix(u + T) 0. Then the sequence 
(T"x + nu)„ 6 ]N is convergent. 


Proof. By Fact |3.^i) ^ (iii)| the sequence (T”x + nv) nr \\\ is Fejer monotone with respect to 
C := Fix(u + T), and C contains a ray. Therefore, intC f 0 and Fact |2. l|(v)| yields the 
convergence of (T”x + nr?)„ 6 iv. B 

Remark 3.7. Example |3. 1 1 shows that the assumption that v f 0 in Theorem |3.6|is important. 
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Theorem 3.8. Suppose that T is affine, say T: x -E Lx + b, where L is linear and nonexpansive, 
and b E X. Suppose furthermore that L is asymptotically regula^ and let x and y be points in X. 
Then 

T n x - T n y = L n (x -y) -e P ¥ix{L) {x - y). (16) 

Proof. Using |j8j Theorem 3.2(h)], we have (Vn E 1ST) T n x — T n y = L n x — L n y = L n (x — 
y). The asymptotic regularity assumption yields L n (x — y) — L n+1 (x — y) —t 0. Using DU 
Proposition 5.27], we see that altogether T n x — T n y = L n (x — y) —t P Fix ( L ) i x ~ y) ■ 

To make further progress we impose now additional assumptions on T. Recall that our 
nonexpansive T is averaged if there exist a nonexpansive operator R : X —» X and a constant 
oc E ]0,1[ such that T = (1 — a) Id +aR; equivalently, (see, e.g., 0] Proposition 4.25]) 

(V* G X)(V 1 / E X) || Tx - Tyf + *=* || (Id -T)x - (Id -T)y\\ 2 < ||x - y|| 2 . (17) 

If a = 1/2, then T is said to be firmly nonexpansive. Averaged operators have proven to be a 
useful class in fixed point theory and optimization; see JT] and Il2l . 

The following result yields a generalized asymptotic regularity for averaged nonexpansive 
operators. 

Lemma 3.9. Suppose that T is averaged and that Fix(u + T) / 0. Then for every x E X, T n x — 
T n+1 x —> v; equivalently, (T n x + nv ) ne n is asymptotically regular. 

Proof. Let x E X and y E Fix(u + T). Since T is averaged, it follows from ( fTz| > and Fact |3.^ii)| 
that there exists oc E ]0,1 [ such that 

(Vn G N) ||T” +1 x - T n+1 y\\ 2 < \\T n x - T n y \\ 2 - i=^|| T n x - T n+1 x - u|| 2 . (18) 

Telescoping yields Jfn=o || T n x — T n+1 x — z?|| 2 < +oo and consequently T n x — T n+1 x —* v. I 

Amazingly, on the real line, averagedness is a sufficient condition for ( fT2] l: 

Theorem 3.10. Suppose that X = R and that T is averaged. Let x and y be in R. Then the sequence 
(T n x — T n y) ne $i is convergent. 

Proof. Set (Vn £ N) a,, := T n x — T n y. We must show that (fl)i)«eN is convergent. From (Tt| , 
there exists oc E ]0,1 [ such that 

(Vn G N) fl 2 +1 + ^(fl n - a„ + i) 2 < a 2 r (19) 

Set f> := 1 — 2 pc and note that 0 < |/1| < 1. By viewing ( fT9| l as a quadratic inequality in a n+ \, 
we learn that 


(Vn G N) |fl n+ i| < | a, 1 1 and a n+ i lies between a n and f>a n . (20) 

^^Recall that T is asymptotically regular at x if T n x — T n+1 x —> 0 and that T is asymptotically regular if it is 
asymptotically regular at every point. 
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If some a„ 0 = 0, then a n —? 0 and we are done. So assume that a n 7^ 0 for every n G IN. If 
(fl„) n6 N changes sign only finitely many times, then {a n ) nr \^ is eventually always positive 
or negative. Since (|«u | )neisr is decreasing, we deduce that (a n )ne'S is convergent. Finally, we 
assume that (fl n )neiN changes signs frequently. If n G N and sgn(a, 1 + i) = — sgn(a„), then 
| fl »z+i| < \f>\\a„\; since this occurs infinitely many times, it follows that a n —>■ 0. ■ 

Theorem 3.11. Suppose that X is finite-dimensional, that T is averaged, that Fix(u + T) 7 ^ 0 , and 
that that codim Fix(u + T) < 1. Then for every (x,y) G X x X, the sequence ( T n x — T n y) ne ^ is 
convergent. 


Proof In view of Remark [3.5| we let x G X and must show that (T H x + nv) ne jn is convergent. 
Set C := Fix(u + T) and (Vn G N) x n := T n x + nv. By Fact |3.^iii) (x n ) „g]Nr is Fejer monotone 
with respect to C. Suppose first that codim C = 0. Then int C / 0 and we are done by 
Fact 2. l|[;v) Now assume that codim C = 1. By Lemma|3.9[ (x n )„ 6 ix is asymptotically regular. 


Altogether, by Theorem 2.8 


is convergent. 


Corollary 3.12. Let x G X. Suppose that X = 1R 2 , that T is averaged, that v 7^ 0, and that 
Fix(u + T) 7^ 0. Then for every {x,y) G X x X, the sequence ( T n x — T n y ) ne ]n is convergent. 


Proof. Because v 7 ^ 0, Fact 3^’i) implies that dimFix(u + T) > 1, i.e., codim Fix(u + T) < 


dim(X) — 1 = 1. The result now follows from Theorem 3.11 


4 Open problems 

We now present a list of open problems that may be easier than the general question ( p~2] ). 
Let x and y be in X. 

PI: Suppose that X = R, v = 0 but Fix(T) = 0 . Is (T n x — T n y) ne t^ convergent? 

P2: Suppose that X = R, v 0 but Fix(u + T) = 0. Is (' T n x — T n y) ne ^ convergent? 

P3: Does Corollary |3.12| remain true if dim(X) > 3? 

P4: What can be said for (fi~2j) if we replace "weakly" by "strongly"? 


Let us conclude with an example which numerically illustrates that the answer to P3 may 
be positive. 

Example 4.1. Suppose that X = IR 3 and let A and B be two closed balls in X. SeflT = 
2 (Id +R b Ra)- Then T is firmly nonexpansive and hence averaged. (In fact, T is the Douglas- 
Rachford operator Ifl4il associated with the sets A and B.) It follows from j5j Theorem 3.5] 
that A Pi (B + v) + C Fix(u + T) C v + A fl (B + v) + N-^gV. Furthermore, 0 

Example 5.7] implies that N A _ p v is a ray, hence Fix(u + T) is ray and therefore dim Fix(r> + 

2 For a nonempty closed convex subset C of X we use Nq, Pc an d Rc '■= 2Pc — Id to denote the normal cone 

operator , the projector and the reflector associated with C, respectively. 
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T) = 1 and so codim Fix(i? + T) = 2. Even though Theorem |3.11| is not applicable here, we 
still conjecture that ( T n x + nv) ne ] n converges (see Figure [ljbelow). 



Figure 1: 
sequence 


A GeoGebra [13| snapshot that illustrates Example 
(T"x + nv) n e isj (blue points) are depicted. 
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